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This  article  discusses  how  explanation-based  learning  of  plan  schemata  from 
observation  can  improve  performance  of  plan  recognition.  The  GENESIS  program 
is  presented  as  an  implemented  system  for  narrative  text  understanding  that 
learns  schemata  and  improves  its  performance.  Learned  schemata  allow  GENESIS 
to  use  schema-based  understanding  techniques  when  interpreting  events  and 
thereby  avoid  the  expensive  search  associated  with  plan-based  understanding. 
Learned  schemata  also  function  as  new  concepts  that  can  be  used  to  cluster 
examples  and  index  events  in  memory.  In  addition,  experiments  are  reviewed 
which  demonstrate  that  human  subjects,  like  GENESIS,  can  learn  a  schema  by 
observing,  explaining,  and  generalizing  a  single  specific  instance  presented  in  a 
narrative. 


1.  INTRODUCTION 

Abstract  knowledge  of  typical  plans,  generally  called  plan  schemata  or 
scripts,  have  been  shown  to  play  an  important  role  in  cognitive  tasks  ranging 
from  text  understanding  (Schank  &  Abelson,  1977)  and  memory  (Bower, 
Black,  &  Turner,  1979)  to  planning  and  problem  solving  (Chi,  Feltovich,  & 
Glaser,  1981).  However,  the  issue  of  how  plan  schemata  are  learned  has 
not  received  much  attention.  To  the  extent  that  the  learning  issue  has  been 
addressed,  it  has  generally  been  assumed  that  plan  schemata  are  learned  by 
induction  across  numerous  experiences  (Lebowitz,  1980;  Rumelhart,  1980; 
Schank  &  Abelson,  1977). 
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This  article  concerns  the  acquisition  of  plan  schemata  from  specific 
observed  instances  by  means  of  explanation-based  learning  (EBL;  DeJong 
&  Mooney,  1986;  Mitchell,  Keller,  &  Kedar-Cabeili,  1986).  EBL  is  capable 
of  learning  a  general  plan  schema  from  a  single  observed  instance  by  build¬ 
ing  and  generalizing  an  explanation  for  how  the  observed  plan  achieves  its 
goal.  The  ability  of  EBL  to  use  existing  knowledge  to  acquire  a  schema  from 
a  single  instance  distinguishes  it  from  similarity-based  learning  methods 
which  induce  concepts  from  numerous  examples  and  counter-examples 
(Medin,  Wattenmaker,  &  Michalski,  1987;  Quinlan,  1986;  Rumelhart, 
Hinton,  &  Williams,  1986). 

In  particular,  this  article  describes  how  EBL  of  plan  schemata  from  ob¬ 
servation  can  improve  the  performance  of  plan  recognition,  the  task  of 
explaining  the  observed  actions  of  others.  In  contrast,  other  work  in  EBL 
has  focused  on  improving  performance  of  classification  or  problem  solving. 
The  process  of  constructing  explanations  for  observed  behavior  is  an  impor¬ 
tant  cognitive  task  which,  compared  to  classification  and  problem  solving, 
has  not  received  the  attention  it  deserves  (Schank,  1986).  In  particular,  very 
little  research  has  addressed  the  problem  of  learning  for  plan  recognition. 
This  article  presents  the  GENESIS  program  as  an  example  of  an  EBL  system 
that  improves  its  abilities  to  explain  observed  behavior.  GENESIS  is  a  narra¬ 
tive  text  comprehension  system  that  improves  its  performance  by  learning 
plan  schemata  from  specific  observed  plans.  The  second  section  describes 
the  problem  of  learning  for  plan  recognition  and  presents  an  overview  of 
GENESIS  as  well  as  an  example  of  it  learning  a  plan  schema  that  improves 
its  performance.  The  third  section  presents  some  details  on  the  design  and 
operation  of  the  GENESIS  system.  The  fourth  section  reviews  psychological 
experiments  demonstrating  that  human  subjects,  like  GENESIS,  are 
capable  of  using  their  existing  knowledge  to  learn  plan  schemata  by  observ¬ 
ing,  explaining,  and  generalizing  a  single  specific  instance.  The  fifth  section 
highlights  the  unique  aspects  of  the  current  work  compared  to  other  research 
in  the  area.  The  sixth  section  notes  several  problems  for  future  research  and 
the  final  section  presents  some  conclusions. 


2.  EBL  FOR  PLAN  RECOGNITION 

Methods  for  plan  recognition  can  be  classified  into  two  basic  approaches 
based  on  whether  or  not  the  system  is  assumed  to  have  an  explicit  represen¬ 
tation  of  the  plan  to  be  recognized.  A  schema-based  (script-based)  system 
attempts  to  access  directly  and  efficiently  a  relatively  specific  knowledge 
structure,  a  plan  schema,  that  accounts  for  the  observed  actions.  Such  a 
system  cannot  understand  an  observed  plan  if  it  does  not  already  have  a 
schema  for  it.  Appropriate  schemata  are  selected  in  a  bottom-up  fashion 
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based  on  cues  in  the  observed  input  and  then  used  in  top-down  manner  to 
connect  actions  causally,  fill  in  missing  actions,  resolve  anaphoric  refer¬ 
ences,  and  so  on.  Examples  of  narrative  understanding  systems  that  use 
schema-based  plan  recognition  are  SAM  (Cullingford,  1978)  and  FRUMP 
(DeJong,  1982).  Recent  work  on  plan  recognition  by  Kautz  and  Allen  (1986) 
also  assumes  the  presence  of  a  complete  set  of  plan  schemata. 

A  plan-based  mechanism,  on  the  other  hand,  can  be  used  to  understand 
novel  situations  for  which  the  system  does  not  have  an  explicit  plan  schema. 
In  this  more  bottom-up  approach,  plan  recognition  involves  searching  for  a 
set  of  missing  actions  that  causally  connect  to  observed  actions  to  form  a 
plan  which  achieves  a  character’s  known  or  inferred  goal.  This  process  can 
be  very  search  intensive  since  it  effectively  requires  constructing  a  plan  in 
order  to  recognize  it;  however,  it  has  the  advantage  of  being  able  to  recog¬ 
nize  a  plan  without  an  explicit  schema.  PAM  (Wilensky,  1978)  is  an  example 
of  a  system  that  performs  plan-based  recognition. 

Since  a  robust  plan  recognition  system  must  be  able  to  deal  with  both 
mundane  and  novel  situations,  more  recent  narrative  understanding  systems 
have  utilized  both  approaches  (Dyer,  1983;  Wilensky,  1983).  GENESIS  also 
uses  both  types  of  plan  recognition  mechanisms.  It  first  tries  to  find  a  single 
schema  that  will  directly  explain  the  characters’  actions.  If  this  fails,  it  tries 
to  connect  individual  actions  causally  in  a  plan-based  manner. 

Since  a  plan  recognition  system  constructs  explanations  for  observed 
actions,  it  is  particularly  well-suited  for  employing  EBL  to  acquire  plan 
schemata  from  observation.  Since  schema-based  recognition  already  requires 
an  existing  schema  in  order  to  recognize  a  plan,  schema  acquisition  is  only 
possible  for  novel  plans  recognized  using  a  plan-based  approach.  By  using 
explanation-based  generalization,  schemata  can  be  acquired  from  the  expla¬ 
nations  constructed  by  a  plan-based  system.  Since  schema-based  recogni¬ 
tion  generally  requires  less  search  than  plan-based  recognition,  learned 
schemata  can  be  used  to  improve  the  performance  of  plan  recognition. 

Consider  a  system  like  GENESIS  that  first  tries  to  access  efficiently  a 
known  schema  to  explain  observed  actions,  and  resorts  to  plan-based  search 
only  if  it  cannot  find  an  appropriate  schema.  In  this  situation,  a  schema  ac¬ 
quired  from  an  initial  plan-based  understanding  of  one  instance  of  a  novel 
plan  will  allow  the  system  to  use  schema-based  processing  to  understand 
subsequent  instances  of  the  plan.  This  is  analogous  to  a  problem-solving 
system  which  learns  macro-operators  (Fikes,  Hart,  &  Nilsson,  1972)  or 
chunks  (Laird,  Rosenbloom,  &  Newell,  1986).  By  avoiding  the  search  asso¬ 
ciated  with  plan-based  recognition,  subsequent  instances  are  understood 
more  efficiently.  Both  plan-based  and  schema-based  understanding  are 
necessary;  however,  an  intelligent  system  should  learn  and  improve  its  per¬ 
formance  by  increasing  its  reliance  upon  the  latter  as  it  gains  experience  in  a 
particular  domain. 


486 


MOONEY 


2.1  Overview  of  GENESIS 

A  diagram  illustrating  the  architecture  of  the  complete  GENESIS  system  is 
shown  in  Figure  1.  In  the  diagram,  circles  represent  declarative  data  struc¬ 
tures  and  rectangles  represent  procedural  subsystems. 

The  parser  translates  Engish  text  into  predicate  calculus  using  an  adapta¬ 
tion  of  McDYPAR  (a  version  of  the  parser  used  in  the  BORIS  system;  Dyer, 
1983).  The  lexicon  stores  word  definitions  and  disambiguation  demons  used 
by  the  parser.  The  parsed  input  is  passed  to  the  understander ,  which  per¬ 
forms  plan-based  and  schema-based  understanding  using  knowledge  from 
the  schema  library.  This  process  causally  connects  the  inputs  and  fills  in  miss¬ 
ing  information.  The  embellished  representation  constructed  for  a  narrative 
is  called  the  causal  model.  An  explanation  for  a  particular  goal  achievement 
is  the  subset  of  the  causal  model  supporting  the  given  goal  state. 

When  building  a  causal  model  for  a  piece  of  text,  the  understander  first 
tries  to  find  a  plan  schema  that  directly  explains  the  characters’  actions. 
If  this  fails,  it  tries  to  connect  individual  actions  causally  in  a  plan-based 
manner.  However,  the  search  it  performs  during  plan-based  understanding 
is  very  limited  in  order  to  prevent  getting  lost  in  a  combinatorially  explosive 
search  of  all  possible  explanations.  Consequently,  GENESIS  cannot  pro¬ 
duce  explanations  for  many  narratives  although  it  theoretically  could  explain 
them  given  an  exhaustive  search  algorithm  and  unlimited  time  and  space. 
Nevertheless,  the  system’s  limited  ability  to  do  plan-based  understanding 
allows  it  to  construct  explanations  for  many  novel  plans. 

GENESIS  also  has  a  number  of  components  for  demonstrating  its  under¬ 
standing.  The  question-answer  (Q/A)  takes  questions  from  the  user  after 
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Figure  1.  GENESIS  architecture. 
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they  have  been  parsed  and  employs  a  number  of  heuristics  for  retrieving 
answers  from  the  causal  model.  Since  the  focus  of  the  system  is  on  the  con¬ 
struction  of  generalizable  explanations,  this  subsystem  is  primarily  built  to 
answer  questions  about  why  a  character  performed  a  certain  action  or  why  a 
particular  state  exists.  The  system  also  has  a  paraphraser  which  uses  the 
most  comprehensive  schemata  instantiated  in  the  causal  model  to  produce  a 
paraphrase  of  the  text.  The  paraphraser  can  also  produce  English  descrip¬ 
tions  of  abstract  schemata  from  the  schema  library.  The  output  of  both  the 
Q/A  and  paraphraser  are  translated  from  predicate  calculus  to  natural  lan¬ 
guage  by  the  generator,  which  is  an  adaptation  of  McMUMBLE  (Schank  & 
Riesbeck,  1981),  a  version  of  the  generator  used  by  the  TALE-SPIN  system 
(Meehan,  1976).  The  vocabulary  contains  information  about  how  to  trans¬ 
late  instances  of  each  predicate  into  natural  language  expressions. 

The  schema  learner  analyzes  the  causal  model  built  by  the  understander 
in  order  to  learn  new  plan  schemata.  It  monitors  the  causal  model  and 
detects  when  a  character  has  acheived  an  important  goal  in  a  novel  manner. 
The  explanations  for  how  such  goals  are  achieved  are  used  to  learn  new 
schemata.  A  domain-indendent,  explanation-based  generalization  system 
called  EGGS  (Mooney,  1990;  Mooney  &  Bennett,  1986)  is  used  to  generalize 
these  explanations  and  package  them  into  plan  schemata.  Learned  schemata 
are  stored  in  the  schema  library  and  indexed  so  they  can  aid  in  the  under¬ 
standing  of  future  narratives. 

GENESIS  also  has  the  ability  to  learn  word  meanings  for  schema-related 
terms.  The  word  learner  can  interpret  unknown  words  as  labels  for  learned 
schemata  or  as  labels  for  the  roles  (slots)  of  learned  schemata  (Mooney, 
1987).  This  subsystem  uses  techniques  similar  to  those  used  by  the  FOUL- 
UP  system  (Granger,  1977).  Finally,  GENESIS  is  able  to  use  learned  sche¬ 
mata  to  index  and  retrieve  specific  events.  The  indexer /retriever  stores 
events  in  the  long-term  store  indexed  under  the  plan  schemata  which  they 
invoked  or  created.  This  allows  for  a  dynamic  memory  that  learns  new  ways 
of  indexing  events  (Schank,  1982). 


2.2  Sample  Performance 

A  standard  procedure  is  used  to  test  the  GENESIS  system.  This  procedure 
illustrates  both  the  schema-learning  process  itself  as  well  as  the  ability  of 
learned  schemata  to  improve  system  performance.  First,  the  system  is  given 
a  test  narrative  that  presents  a  sparse  description  of  an  instance  of  a  schema. 
This  description  is  missing  a  number  of  actions  crucial  to  the  overall  plan. 
Consequently,  the  narrative  is  not  detailed  enough  for  the  system  to  con¬ 
struct  a  causally  complete  explanation  for  characters’  actions  without  a 
schema  to  supply  missing  actions  and  inferences.  The  system  is  therefore 
unable  to  answer  questions  that  require  making  default  inferences  about 
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what  must  have  taken  place,  and  it  is  unable  to  produce  an  adequate  para¬ 
phrase  of  the  narrative.  Next,  the  system  is  given  a  learning  narrative  that 
describes  in  detail  a  complete  instance  of  the  schema  and  contains  the  crucial 
actions  and  other  information  that  were  lacking  in  the  test  narrative.  Using 
its  existing  knowledge  and  limited  plan-based  recognition  abilities,  GENESIS 
is  able  to  construct  a  causally  complete  explanation  for  this  narrative  and 
can  therefore  answer  questions  about  why  actors  performed  certain  actions 
as  well  as  produce  an  adequate  paraphrase  of  the  text.  Since  the  narrative 
presents  a  novel  plan  that  achieves  an  important  goal,  the  system  generalizes 
its  explanation  of  how  the  goal  was  achieved  into  a  new  plan  schema.  Finally, 
GENESIS  is  given  the  test  narrative  again.  This  time,  it  can  use  the  schema 
it  has  just  learned  to  fill  in  missing  information,  and  as  a  result,  it  can  now 
answer  questions  it  was  previously  unable  to  answer,  as  well  as  produce  a 
better  paraphrase  of  the  text. 

The  remainder  of  this  section  presents  an  example  in  which  GENESIS 
learns  a  schema  for  a  police  officer  impersonating  a  prostitute  in  order  to 
arrest  solicitors.1  Before  processing  the  narratives  in  this  example,  the  sys¬ 
tem  has  schemata  for  people  soliciting  sexual  favors  and  for  police  officers 
arresting  lawbreakers;  however,  it  does  not  have  a  schema  for  “solicitation 
entrapment.”  In  order  to  illustrate  the  system’s  current  ignorance  of  this 
schema  and  how  this  lack  of  knowledge  affects  its  ability  to  understand  cer¬ 
tain  narratives,  the  system  is  first  given  a  test  narrative.  Below  is  the  actual 
I/O  trace  produced  by  the  system: 

Input:  Alice  was  at  a  corner  wearing  tight  blue  jeans.  Stan  told  Alice  if  she  had 

sex  with  him  then  he  would  give  her  $75.  Stan  went  to  jail. 

Ready  for  questions: 

>  Paraphrase. 

Stan  solicited  Alice’s  sexual  favors  for  $75.  Stan  was  put  in  a  jail. 

>  Why  did  Stan  tell  Alice  if  she  had  sex  with  him  then  he  would  give  her  money? 

Because  Stan  believed  that  Alice  was  a  prostitute  and  because  Stan  needed  to 

have  sex. 

>  Who  arrested  Stan? 

Answer  unknown. 

Since  the  arresting  action  is  not  explicitly  mentioned,  the  limited  plan-based 
procedures  cannot  connect  Stan’s  incarceration  to  his  solicitation.  Conse¬ 
quently,  it  is  unable  to  answer  certain  questions  or  produce  an  adequate 
paraphrase  of  the  text.  Next  the  system  is  given  the  following  more  detailed 
learning  narrative.1 

1  Other  schemata  GENESIS  has  learned  and  used  include:  kidnapping  for  ransom,  arson  for 
insurance,  and  murder  for  inheritance.  Mooney  (1990)  gives  details  on  these  other  examples. 

1  Leading  question  marks  indicate  variables.  Variables  in  the  description  of  a  schema  are 
assumed  to  be  existentially  quantified. 
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Input:  Jane  is  a  policewoman.  She  dressed  in  a  short  red  skirt  and  went  to  a 
corner.  Bob  approached  the  corner  and  told  her  if  she  had  sex  with  him  then 
he  would  give  her  $50.  Jane  arrested  Bob  for  soliciting.  Bob  is  Mary’s  husband 
and  he  told  her  that  Jane  entrapped  him. 

Thematic  goal  achieved:  Jane  is  happy  that  Bob  is  under  arrest  for  solicting 
Jane’s  sexual  favors  for  the  $50. 

Explanation  suitable  for  generalization.  Pruning.. .Generalizing. ..Packaging... 
Creating  New  Schema:  (DressSolicitArrest  ?b9  ?c2  ?s2  ?s4  ?14  ?a9  ?c3) 

?b9  is  not  equal  to  ?a9.  ?b9  is  a  person.  ?c2  is  an  apparel.  ?b9  has  ?c2.  ?b9 
puts  on  ?c2.  ?s2  is  a  location.  ?14  is  a  corner.  ?b9  is  at  ?s2.  ?b9  goes  from  ?s2  to 
?14.  ?a9  is  a  person.  ?s4  is  a  location.  ?a9  is  at  ?s4.  ?s9  goes  from  ?s4  to  ?14.  ?c3 
is  money.  ?a9  needs  to  have  sex.  ?c2  is  sexy.  ?a9  solicits  ?b9's  sexual  favors  for 
?c3.  ?b9  is  a  police  officer.  ?b9  arrests  ?a9  for  soliciting  ?b9’s  sexual  favors  for 
?c3. 

Having:  ?b9  put  on  ?c2.  suggests  DressSolicitArrest 
Having:  ?a9  solicited  ?b9’s  sexual  favors  for  ?c3.  suggest  DressSolicitArrest 
Having:  ?b9  arrested  ?a9  for  soliciting  ?b9’s  sexual  favors  for  ?c3,  suggest 
DressSolicitArrest 

Unknown  word  ’?b9  entrap  ?a9’  refers  to  DressSolicitArrest 
Ready  for  questions: 

>  Paraphrase. 

Jane  had  a  skirt.  Jane  put  on  a  skirt.  Jane  was  at  some  place.  Jane  went  to  a 
corner.  Bob  was  at  some  place.  Bob  went  to  the  corner.  Bob  needed  to  have 
sex.  The  skirt  was  sexy.  Bob  solicited  Jane’s  sexual  favors  for  $50.  Jane  was  a 
police  officer.  Jane  arrested  Bob  for  soliciting  Jane’s  sexual  favors  for  the  $50. 

>  Why  did  Bob  go  to  the  corner? 

So  Bob  could  solicit  Jane’s  sexual  favors  for  the  $50. 

>Why  did  Bob  solicit  Jane’s  sexual  favors? 

Because  Bob  believed  that  Jane  was  a  prostitute  and  because  Bob  needed  to 
have  sex. 

>  Why  did  Jane  arrest  Bob? 

Because  Jane  believed  that  Bob  solicited  Jane’s  sexual  favors  for  the  $50  and 
because  Jane  was  a  police  officer. 

This  time,  because  the  arrest  is  explicitly  mentioned,  the  system  can  connect 
it  to  the  solicitation  and  thereby  construct  an  adequate  explanation  for  the 
story.  The  system  generalizes  its  explanation  for  how  Jane  achieved  her  goal 
of  arresting  someone  into  a  DressSolicitArrest  schema  and  indexes  it  so  that 
future  solicitations  suggest  this  new  schema.  The  system  also  associates  the 
unknown  word  “entrap”  with  the  new  schema.  Although  entrapment  is 
actually  a  more  general  concept,  this  association  is  a  good  initial  conjecture. 

When  the  test  narrative  is  processed  again,  Stan’s  solicitation  suggests 
DressSolicitArrest  and  since  this  schema  explains  other  facts  in  narrative 
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(e.g.,  why  Stan  went  to  jail),  the  test  narrative  is  understood  as  an  instance 
of  the  new  schema. 

Input:  Alice  was  at  a  corner  wearing  tight  blue  jeans.  Stan  told  Alice  if  she  had 
sex  with  him  then  he  would  give  her  $75.  Stan  went  to  jail. 

Thematic  goal  achieved:  Alice  is  happy  that  Stan  is  under  arrest  for  soliciting 
Alice’s  sexual  favors  for  the  $75. 

Ready  for  questions: 

>  Paraphrase. 

Alice  had  a  pair  of  jeans.  Alice  put  on  the  pair  of  jeans.  Alice  was  at  some 
place.  Alice  went  to  a  comer.  Stan  was  at  some  place.  Stan  went  to  the  corner. 
Stan  needed  to  have  sex.  The  pair  of  jeans  were  sexy.  Stan  solicited  Alice’s 
sexual  favors  for  $75.  Alice  was  a  police  officer.  Alice  arrested  Stan  for  solicit¬ 
ing  Alice’s  sexual  favors  for  the  $75. 

>  Who  arrested  Stan? 

Alice  arrested  Stan  for  soliciting  Alice’s  sexual  favors  for  the  $75. 

>  Why  did  Alice  arrest  Stan? 

Because  Alice  was  a  police  officer  and  because  Alice  believed  that  Stan  solicited 
Alice’s  sexual  favors  for  the  $75. 

3.  DETAILS  OF  THE  GENESIS  SYSTEM 

This  section  provides  further  details  on  the  design  and  operation  of  the 
GENESIS  system.  In  particular,  it  describes  the  knowledge  representation, 
plan  recognition,  and  learning  aspects  of  the  system.  Mooney  (1990)  pro¬ 
vides  further  information,  including  detailed  descriptions  of  the  algorithms 
used  by  the  system. 

3.1  Knowledge  Representation  in  GENESIS 

All  domain-specific  knowledge  in  GENESIS  is  represented  declaratively 
in  the  schema  library.  This  knowledge  is  divided  into  information  about 
objects ,  attributes ,  states,  and  actions  which  are  further  organized  into  tax¬ 
onomic  hierarchies.  The  hierarchies  under  each  of  these  classes  of  knowledge 
support  abstraction  inferences  such  as:  Isa(?x,  Gun)— Isa(?x,  Weapon), 
Mother(?x,  ?y)— Parent(?x,  ?y),  and  Poison(?x,  ?y)— Murder(?x,  ?y). 
Attributes  refer  to  facts  about  an  object  that  are  not  affected  by  actions 
while  states  refer  to  facts  about  objects  that  can  be  altered.  Attributes  and 
states  can  both  have  Horn-clause  rules  associated  with  them.  For  example, 
the  example  given  above  makes  use  of  the  following  rule: 

At(?x,  ?l)AAt(?y,  ?l)Alsa(?l,  Comer)AAttire(?y,  ?c)ASeductive(?c)— 
Believe(?x,  Occupation(?y,  prostitute)) 

This  rule  simply  states  that  if  ?x  and  ?y  are  at  a  corner  and  ?y  is  wearing 
seductive  clothing  then  ?x  will  believe  that  ?y  is  a  prostitute. 
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TABLE  1 

Supports  and  Effects  for  Arrest{?a,?b,?d(?b)) 


Constraints 

Preconditions 

Motivations 

Effects 

lsa(?a,  Character) 
lsa(?b,  Character) 
— iEqual(?a,?b) 

1  llegal(?d(?b) ) 

At(?b,?l) 

At(?a,?l) 

Believe(?a,?d(?b)) 
Occupation(?a, police  officer) 

Arrested(?b,?d(?b),?o) 

TABLE  2 

Supports  and  Effects  for  Solicit(?a,?b,?o) 

Constraints 

Preconditions 

Motivations 

Effects 

lsa(?a,Person)  CommPath(?a.?b)  NeedSex(?a)  Believe(?b, 

lsa(?b, Person)  Believe(?a,  Solicit(?a,?b,?o)) 

lsa(?o,Money)  Occupation(?b,prostitute) } 

Most  of  GENESIS’  knowledge  is  in  the  form  of  action  definitions.  Actions 
are  represented  using  an  enhancement  of  STRIPS  operators  with  precondi¬ 
tion,  add,  and  delete  lists  (Fikes  et  al.,  1972).  The  first  modification  is  that 
preconditions  are  divided  into  constraints ,  preconditions and  motivations. 
Constraints  are  required  attributes  or  classes  of  the  arguments  of  an  action 
and  therefore  cannot  be  achieved  by  other  actions.  Preconditions  are 
physical  states  of  the  world  that  enable  an  action  and  can  be  achieved  by 
other  actions.  Motivations  are  mental  states  of  the  actor,  such  as  goals,  goal 
priorities,  and  beliefs,  that  motivate  him  to  perform  a  volitional  action. 
Together,  constraints,  preconditions,  and  motivations  are  called  the  supports 
of  an  action.  Effects  of  an  action  are  states  resulting  from  the  execution  of 
an  action.  Deletions  are  simply  negated  effects.  Actions  also  inherit  supports 
and  effects  from  more  abstract  actions  in  the  hierarchy.  Tables  1  and  2  give 
the  supports  and  effects  for  the  following  actions  used  in  the  example:  “?a 
arrests  ?b  for  performing  act  ?d”  and  “?a  solicits  ?b*s  sexual  favors  for  an 
amount  ?o.”3  An  Arrest  requires  that  the  officer  and  the  offender  be  at  the 
same  place  and  is  motivated  by  the  officer  believing  that  the  offender  per¬ 
formed  an  illegal  act.  A  Solicit  requires  that  the  actor  have  a  communica¬ 
tion  path  to  the  recipient  and  is  motivated  by  the  actor  needing  to  have  sex 
and  believing  that  the  recipient  is  a  prostitute. 

Knowledge  about  an  action  may  include  information  about  its  expansion , 
that  is,  its  decomposition  into  more  primitive  actions.  In  this  case  an  action 
is  recursively  defined  as  a  plan  schema  that  has  an  expansion  in  terms  of 
other  actions.  The  expansion  of  an  action  specifies  the  set  of  subactions  that 


J  The  tables  use  two  predicates.  Character  and  Person,  which  are  subtly  different.  A  Person 
is  a  human  being  while  a  Character  is  any  agent  capable  of  executing  a  volitional  action  and  in¬ 
cludes  Persons  as  well  as  collective  agents  such  as  Companies. 
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comprise  the  plan  schema  and  may  also  include  other  information  such  as 
temporal  and  causal  ordering  constraints  on  the  subactions.  For  example,  the 
expansion  of  the  Arrest  schema  might  include  the  following  ordered  list  of 
subactions:  Mtrans(?a,  ?b,  Miranda  rights)  (the  officer  reads  the  accused  his 
rights),  Handcuff(?a,  ?b)  (the  officer  handcuffs  the  accused),  and  Ptrans(?a, 
?b,  ?11,  ?12)  (the  officer  takes  the  accused  to  the  police  station). 

3.2  Plan  Recognition  in  GENESIS 

As  previously  mentioned,  GENESIS  uses  both  schema-based  and  plan-based 
understanding  mechanisms  when  constructing  explanations  for  characters’ 
actions.  This  section  describes  each  of  these  processes,  using  the  “solicitation 
entrapment”  narratives  as  examples. 

3.2. 1  Schema  Selection .  If  a  schema-based  mechanism  is  to  be  able  to 
process  a  broad  range  of  texts,  it  must  have  access  to  a  large  number  of  sche¬ 
mata.  Therefore,  in  order  to  avoid  repeated  searching  through  the  entire 
database  of  schemata,  it  must  have  an  efficient  method  for  selecting  the  par¬ 
ticular  schemata  applicable  to  the  current  input.  This  is  a  difficult  problem, 
frequently  referred  to  as  schema  selection  ox  frame  selection,  and  has  been 
the  subject  of  several  research  efforts  (Charniak,  1982;  DeJong,  1982; 
Norvig,  1983). 

In  GENESIS,  the  process  of  selecting  a  schema  has  two  stages:  sugges¬ 
tion  and  determination.  An  action  A  in  a  narrative  suggests  a  schema  B  if  A 
is  a  subaction  of  B  and  the  objects  filling  the  case  roles  of  A  satisfy  the  con¬ 
straints  on  the  corresponding  roles  of  B.  For  example,  when  processing  the 
solicitation  test  narrative  after  acquiring  the  DressSolicitArrest  schema, 
Stan’s  action  of  soliciting  Alice  suggests  the  new  schema  since  Solicit  is  one 
of  the  schema’s  subactions. 

Suggested  schemata  monitor  the  inputs  in  order  to  find  confirming  evi¬ 
dence  in  the  form  of  additional  inputs  that  match  states  or  actions  in  its 
expansion.  When  all  of  the  subactions  of  a  suggested  schema  have  been 
observed  or  inferred  as  filling  a  gap  in  a  causal  chain  of  events,  it  is  deter¬ 
mined,  and  its  complete  expansion  is  added  to  the  causal  model.4  A  single  ac¬ 
tion  may  suggest  several  schemata,  the  determination  process  chooses  which 
of  these  schemata  actually  to  use  in  its  interpretion  of  the  text.  In  the  sample 
test  narrative,  when  the  new  schema  is  suggested,  its  Dress  and  Ptrans  sub-, 
actions  are  immediately  inferred  as  explaining  how  Alice  got  to  the  corner 
wearing  the  jeans.  When  the  input:  “Stan  went  to  jail”  is  processed,  the  sys¬ 
tem  infers,  as  a  necessary  precondition,  that  he  is  under  arrest.  This  fact 
matches  the  effect  of  the  Arrest  action  in  the  suggested  DressSolicitArrest 
schema  thereby  causing  the  Arrest  action  to  be  inferred  as  filling  a  gap  be- 


*  The  term  determination  is  taken  from  Norvig  (1983)  who  uses  it  to  refer  to  a  similar 
process  in  FAUSTUS. 
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tween  Stan’s  solicitation  and  his  incarceration.  Since  all  of  its  subactions 
have  been  observed  or  inferred,  the  new  schema  is  determined  and  its  expan¬ 
sion  is  added  to  the  causal  model. 

3.2.2  Plan  Verification.  While  processing  a  narrative,  if  GENESIS  en¬ 
counters  an  input  action  that  does  not  match  part  of  an  existing  or  suggested 
schema,  nor  suggest  any  schemata,  it  attempts  to  explain  the  action  in  a  plan- 
based  fashion  by  causally  connecting  it  to  previous  actions.  Using  a  process 
called  plan  verification ,  the  system  attempts  to  show  that  a  set  of  known 
actions  achieves  a  character’s  goal.  In  order  to  avoid  combinatorially  explo¬ 
sive  search,  it  does  not  attempt  to  propose  missing  actions  that  might  com¬ 
plete  an  explanation. 

Specifically,  plan  verification  uses  backward  chaining  to  try  to  infer  the 
supports  of  observed  actions  from  given  facts  and  the  effects  of  previous  ac¬ 
tions.  By  inferring  the  preconditions  of  actions  from  the  effects  of  previous 
actions,  causally  connected  sequences  are  identified.  In  the  sample  learning 
narrative,  the  preconditions  and  motivations  of  Bob’s  solicitation  are  in¬ 
ferred  from  the  effects  of  previous  actions.  Specifically,  the  precondition 
requiring  that  there  be  a  communication  path  between  the  actor  and  the 
recipient  is  inferred  from  the  fact  that  they  are  both  at  the  same  corner,  an 
effect  of  their  previously  mentioned  movements.  The  motivation  stating 
that  Bob  believes  that  Jane  is  a  prostitute  is  inferred  from  the  fact  that  she  is 
standing  on  a  corner  dressed  in  seductive  clothing,  an  effect  of  her  previously 
mentioned  Dress  and  Ptrans  actions.  The  preconditions  and  motivations  of 
Jane’s  Arrest  action  are  connected  to  previous  actions  in  a  similar  manner. 

Complete  plan  recognition  involves  finding  a  connected  set  of  actions 
which  achieve  a  character’s  ultimate  goal.  Since  narratives  rarely  explicitly 
mention  characters’  ultimate  goals,  the  system  must  have  a  way  of  inferring 
them.  Thematic  goals  (Schank  &  Abelson,  1977)  are  defined  as  goals  arising 
from  basic  wants  and  needs  and  therefore  requiring  no  further  explanation. 
GENESIS  has  a  set  of  inference  rules  for  determining  when  a  thematic  goal 
has  been  achieved.  For  example,  the  following  rule  defines  a  police  officer’s 
thematic  goal  of  wanting  to  arrest  lawbreakers: 

Arrested(?b,?d,?a)AOccupation(?a,  police  officer)— 

ThemeGoaIMet(?a,  Arre$ted(?b,  ?d,  ?a)) 

GENESIS  checks  input  actions  and  determined  schemata  to  see  if  they  can 
be  explained  as  achieving  a  thematic  goal  for  some  character.  In  the  example, 
the  above  rule  is  used  to  determine  that  Bob’s  arrest  has  achieved  a  thematic 
goal  for  Jane.  Figure  2  shows  the  final  causal  model  constructed  for  this 
example. 

Notice  that,  unlike  a  PAM-type  (Wilensky,  1978)  of  system,  plan  verifi¬ 
cation  does  not  conduct  an  exponential  search  for  missing  actions,  which 
would  create  a  causal  chain  of  actions  achieving  a  thematic  goal.  Rather,  it 
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Arrested2  Bob  is  under  arrest  for  soliciting  Jane’s  sexual  favors  for  the  $50. 

Arrestl  Jane  arrested  Bob  for  soliciting  Jane’s  sexual  favors  for  the  $50. 

Believe2  Jane  believes  that  Bob  solicited  Jane’s  sexual  favors  for  the  $50. 


Solicitl  Bob  solicited  Jane’s  sexual  favors  for  the  $50. 

NeedSex2  Bob  needs  to  have  sex. 

Believe4  Bob  believes  that  Jane  is  a  prostitute. 

Attire2  Jane  is  wearing  the  skirt. 
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Flgur«  2.  Causal  model  for  the  solicitation  learning  narrative. 
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simply  tries  to  verify  that  existing  actions  causally  connect  to  achieve  such  a 
goal.  Therefore,  the  system  is  incapable  of  constructing  explanations  for 
narratives  that  have  missing  actions  and  do  not  suggest  known  schemata. 
For  example,  consider  the  processing  of  the  solicitation  test  narrative  before 
the  system  learns  the  schema.  Since  there  is  no  explicit  mention  of  an  arrest, 
the  system  is  incapable  of  connecting  Bob’s  solicitation  to  his  incarceration. 
There  are  lots  of  potential  actions  enabled  by  his  solicitation:  Alice  could 
accept  the  offer,  they  could  haggle  over  the  price,  Alice  could  be  insulted 
and  slap  Bob,  and  so  on.  There  are  also  many  explanations  for  why  Stan 
was  sent  to  jail.  He  could  have  been  in  possession  of  drugs,  he  could  have 
murdered  someone,  and  so  forth.  A  plan-based  system  with  a  large  knowl¬ 
edge  base  of  actions  might  search  a  long  time  before  stumbling  upon  the 
right  way  to  connect  things.  Since  any  real  system  is  constrained  by  limita¬ 
tions  on  time  and  space,  there  will  always  be  observations  which  it  cannot 
explain  even  if  it  has  all  the  relevant  knowledge. 

Of  course,  plan  verification  is  not  necessarily  the  best  possible  way  to 
limit  search  during  plan-based  understanding.  Plan  verification  probably 
limits  search  a  little  too  much  since  people  can  often  understand  novel  plans 
which  require  filling  in  one  or  two  missing  actions.  However,  searching 
for  missing  actions  must  be  tightly  constrained  since  it  quickly  becomes 
intractable. 

3.3  Schema  Learning  in  GENESIS 

If  the  understander  constructs  an  explanation  for  how  a  goal  is  achieved, 
GENESIS  may  be  able  to  generalize  this  explanation  into  a  new  schema  that 
can  aid  the  understanding  of  future  narratives.  First,  the  system  decides 
whether  or  not  an  explantion  is  worth  generalizing.  Second,  a  pruning  pro¬ 
cedure  eliminates  overly  specific  parts  of  the  explanation.  Third,  explanation- 
based  generalization  is  performed.  Fourth,  the  generalized  explanation  is 
packaged  into  a  new  schema  and  indexed  so  that  its  subactions  suggest  it. 
The  following  subsections  elaborate  each  of  these  steps  of  the  learning 
process. 

3,3,1  Deciding  When  to  Learn.  If  every  explanation  GENESIS  constructed 
were  generalized  into  a  schema,  the  system  would  eventually  become  over¬ 
loaded  with  rarely  used  schemata.  Most  actions  would  suggest  a  large  num¬ 
ber  of  schemata,  and  selecting  among  these  would  require  an  excessive 
amount  of  processing  time.  This  problem  is  an  analogous  to  the  perfor¬ 
mance  deterioration  noticed  in  problem-solving  systems  that  learn  too  many 
useless  macro-operators  (Minton,  1985).  In  an  attempt  to  avoid  this  prob¬ 
lem,  GENESIS  has  criteria  for  learning  schemata  selectively.  Below  is  the 
set  of  criteria  GENESIS  uses  to  determine  whether  an  explanation  is  worth 
generalizing. 
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1.  It  should  be  an  explanation  of  how  a  thematic  goal  was  achieved. 

2.  The  highest  level  explanation  for  the  goal  achievement  should  not  simply 
be  an  instantiation  of  a  known  schema. 

3.  All  actions  in  the  highest  level  explanation  should  rely  upon  the  char¬ 
acter  whose  thematic  goal  was  achieved. 

The  first  criterion  is  crucial  for  insuring  that  the  acquired  schema  will  be  a 
useful  one.  A  plan  for  achieving  a  state  that  satisfies  normal  human  wants 
and  desires  is  likely  to  make  a  schema  that  will  arise  again  and  again.  There¬ 
fore,  an  explanation  for  a  plan  is  considered  to  be  worth  generalizing  into  a 
schema  only  if  it  achieves  a  thematic  goal.  The  explanation  in  Figure  2  meets 
this  criteria  since  Alice  achieves  her  thematic  goal  of  arresting  criminals. 

The  second  criterion  is  the  obvious  one  of  not  already  possessing  a  schema 
for  the  combination  of  actions  needed  to  achieve  the  goal.  This  simply  in¬ 
volves  checking  the  explanation  for  the  goal  achievement  to  make  sure  it 
consists  of  a  chain  of  several  schemata  rather  than  a  single  schema.  If  the 
system  already  had  a  schema  for  this  case,  it  would  have  used  it  in  process¬ 
ing  the  narrative  and  the  goal  achievement  would  be  explained  by  a  single 
instance  of  this  schema.  The  explanation  in  Figure  2  meets  this  criterion 
since  it  consists  of  a  combination  of  several  actions  including  Dress,  Solicit, 
and  Arrest. 

The  third  and  final  criterion  insures  that  the  schema  learned  from  the 
explanation  is  a  volitional  plan  which  agents  can  use  to  achieve  their  own 
thematic  goals.  Let  the  term,  main  character,  refer  to  the  character  whose 
thematic  goal  was  achieved.  If  the  learned  schema  is  to  represent  a  plan  that 
can  be  executed  by  the  main  character  in  order  to  achieve  his  thematic  goal, 
actions  in  the  explanation  that  are  not  volitionally  performed  by  the  main 
character  should  at  least  be  motivated  or  initiated  by  actions  that  he  per¬ 
forms.  The  solicitation  example  satisfies  this  criterion  even  though  the  Solicit 
action  is  performed  by  another  agent,  since  it  is  motivated  by  the  fact  that 
the  main  character  (Alice)  is  dressed  seductively  and  standing  on  a  corner.  If 
the  third  criterion  were  not  used,  the  system  could  learn  schemata  contain¬ 
ing  serendipitous  actions  over  which  the  main  character  has  no  control.  For 
example,  assume  GENESIS  had  the  knowledge  to  explain  the  following  nar¬ 
rative  but  did  not  have  the  third  learning  criterion. 

John’s  rich  uncle  was  killed  in  an  earthquake.  John  inherited  a  million  dollars. 

Such  a  system  would  acquire  an  Earthquakelnherit  schema  (or  possibly  a 
NaturalDisasterlnherit  schema)  from  its  explanation  of  this  narrative.  Such 
a  nonvolitional  schema  would  not  be  very  useful  for  understanding  later 
narratives  since  a  natural  disaster  cannot  normally  be  explained  as  part  of  a 
character’s  plan  to  inherit  riches. 
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3.3.2  Pruning  the  Explanation.  If  an  explanation  meets  all  three  learning 
criteria,  GENESIS  proceeds  to  generalize  it  into  a  new  schema.  Certain  fea¬ 
tures  of  the  example  are  immediately  generalized  away  since  they  do  not  con¬ 
tribute  to  the  explanation  of  how  the  goal  was  achieved.  For  example,  the 
disconnected  facts  shown  in  Figure  2  concerning  the  names  of  the  various 
characters  and  the  color  of  the  skirt  are  clearly  irrelevant  to  the  general 
schema.  In  order  to  increase  the  generality  and  applicability  of  the  resulting 
schema  even  further,  GENESIS  has  a  pruning  procedure  that  removes  un¬ 
necessarily  specific  branches  from  the  explanation  prior  to  generalization. 
If  such  pruning  were  not  performed,  the  system  would  frequently  learn  sche¬ 
mata  too  restrictive  to  be  useful.  For  example,  if  the  explanation  in  Figure  2 
were  not  pruned,  the  resulting  schema  would  only  cover  cases  in  which  an 
officer  used  a  short  skirt  to  impersonate  a  prostitute. 

The  pruning  procedure  removes  actions  that  only  support  the  thematic 
goal  achievement  through  more  abstract  actions  in  the  taxonomic  hierarchy. 
It  also  removes  inference  rules  at  the  leaves  of  the  explanation  since  such 
rules  are  only  used  to  show  how  the  supports  of  the  overall  plan  were  met  in 
the  specific  example.  In  the  solicitation  example,  the  pruning  process 
removes  the  rule  stating  that  short  skirts  are  seductive,  thereby  allowing  the 
constraint  of  seductive  attire  to  be  achieved  differently  in  future  examples. 

3.3.3  Generalizing  and  Packaging  the  Explanation.  Once  an  explanation 
is  pruned,  it  is  generalized  using  standard  explanation-based  generalization 
(DeJong  &  Mooney,  1986;  Mitchell  et  al.,  1986).  This  process  appropriately 
variablizes  the  explanation  while  maintaining  any  constraints  needed  for  its 
validity.  In  particular,  GENESIS  uses  the  generalizer  in  the  EGGS  domain- 
independent  EBL  system  (Mooney,  1990;  Mooney  &  Bennett,  1986). 5  This 
generalizer  computes  the  minimal  variable  bindings  needed  to  allow  the  gen¬ 
eral  rules  and  actions  used  in  the  construction  of  the  explanation  to  connect 
in  the  way  they  did  in  the  example.  For  the  solicitation  example,  the  final 
generalized  explanation  resulting  from  this  process  is  shown  in  Figure  3. 

The  final  step  in  acquiring  a  schema  is  packaging  the  generalized  expla¬ 
nation  into  a  form  suitable  for  the  schema  library.  First,  the  leaves  of  the 
generalized  explanation  are  divided  into  constraints,  preconditions,  and 
motivations  based  on  the  manner  in  which  they  support  actions  in  the  gener¬ 
alized  explanation.  The  subactions  and  internal  structure  of  the  generalized 
explanation  are  stored  as  the  expansion  of  the  new  schema.  A  description  of 
the  DressSolicitArrest  schema  is  shown  in  Table  3  and  an  English  summary 
is  shown  in  the  trace  in  Section  2.2. 


1  The  initial  prototype  implementation  of  GENESIS  presented  by  Mooney  and  DeJong  (1985) 
used  an  ad  hoc  generalizer  which  employed  a  representational  language  based  on  conceptual 
dependency  forms. 
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TABLE  3 

Learned  Definition  for  DressSolicitArrest(?b9,?c2,?s2.?s4,?l4,?a9,?c3) 


Subactions 

Dress(?b9,?c2) 

Ptrans(?b9,?b9,?s2,?l4)  Prtans(?a9.?a9,?s4.?l4)  $olicit(?o9,?b9,?c3) 
Arrest(?b9,?a9,Solicit{?a9I?b9,?c3) ) 

Constraints 

Preconditions 

Motivations 

Effects 

lsa(?c3,Money) 
Isa(?a9, Person) 
lsa(?b9,Person) 

— iEqual(?a9,?b9) 
lsa(?s2,Location) 
Isa(?s4,  Location) 
Isa{?l4, Corner) 
lsa(?c2.Apparel) 
Seductive(?c2) 

At(?a9,?s4) 

At(?b9,?s2) 

Possess{?b9,?c2) 

NeedSex(?a9) 

Occupation(?b9. 
police  officer) 

Attire(?b9.?c2) 

— iAt(?b9,?s2) 

— iAt(?a9,?s4) 

At(?b9,?l4) 

At(?a9.?l4) 

Believe(?b9, 
Solicit(?a9,?b9,?c3) ) 
Arrested(?a9, 

Solicit(?a9,?b9,?c3),?b9) 

The  final  aspect  of  packaging  a  new  schema  is  indexing  the  schema  so 
that  the  system  is  “reminded”  of  it  whenever  it  might  be  helpful  in  process¬ 
ing  a  future  narrative.  Indexing  is  performed  by  having  the  schema’s  voli¬ 
tional  subactions  suggest  it.  This  is  appropriate  because  the  new  schema 
may  now  provide  an  explanation  for  why  someone  is  executing  the  subaction. 
For  example,  whenever  the  system  encounters  someone  soliciting  a  prostitute, 
the  new  DressSolicit Arrest  schema  is  suggested.  If  this  schema  accounts  for 
other  observed  information,  it  may  eventually  be  determined,  and  add  to  the 
interpretation  of  the  event.  This  process  allows  the  system  to  understand  the 
solicitation  test  narrative  as  described  in  Section  3.2.1. 

4.  PSYCHOLOGICAL  EVIDENCE 

Although  a  number  of  experiments  have  demonstrated  people’s  ability  to 
learn  concepts  or  schemata  from  two  examples  using  analogy  (Gick  &  Holy- 
oak,  1983)  or  from  many  examples  using  similarity-based  induction  (Medin 
et  al.  1987),  until  very  recently,  there  were  apparently  no  experiments  that 
demonstrated  people’s  ability  to  learn  a  concept  or  schema  by  explaining 
and  generalizing  a  single  example.  Nevertheless,  as  reviewed  by  Murphy  and 
Medin  (1985),  there  is  a  substantial  amount  of  psychological  research  that 
reveals  the  important  effect  subjects’  background  knowledge  and  theories 
of  the  world  have  on  the  process  of  concept  acquisition.  This  section  reviews 
a  series  of  recent  experiments  which  indicate  that  people,  like  GENESIS, 
can  use  their  existing  knowledge  to  learn  a  plan  schema  by  observing,  ex¬ 
plaining,  and  generalizing  a  single  specific  instance  presented  in  a  narrative. 
Ahn,  Mooney,  Brewer,  and  DeJong  (1987)  present  a  complete  review  of 
these  experiments  and  Ahn  (1987)  details  the  experimental  methodology. 
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Isa44  ?b9  is  a  person. 

Possess  1  ?b9  has  ?c2. 

Seductive  1  ?c2  is  sexy. 


At3  ?b9  is  at  ?I4. 

Ptransl  ?b9  went  from  ?s2  to  ?I4. 

Isa  12  ?I4  is  a  location. 

Isa45  ?I4  is  a  corner. 
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Flgur*  3.  Generalized  explanation  for  the  solicitation  learning  narrative. 
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The  overall  design  of  the  experiments  involved  subjects  reading  a  single 
narrative  describing  a  specific  instance  of  a  novel  plan  and  performing  a 
variety  of  tests  constructed  to  determine  whether  or  not  they  had  acquired 
an  abstract  schema  from  this  single  example.  Three  passages  were  constructed 
to  present  situations  for  which  the  subjects  presumably  did  not  already  have 
a  schema  but  which  they  could  understand  using  plan-based  understanding. 
For  example,  one  passage  involves  a  cooperative  buying  scheme  used  in  some 
countries.  In  Korea  the  system  is  called  a  “kyeah,”  and  in  India  it  is  called  a 
“chit  fund.”  The  experimental  narrative  describing  a  single  instance  of  this 
plan  follows: 

Tom,  Sue,  Jane,  and  Joe  were  all  friends  and  each  wanted  to  make  a  large  pur¬ 
chase  as  soon  as  possible.  Tom  wanted  a  VCR,  Sue  wanted  a  microwave,  Joe 
wanted  a  car  stereo,  and  Jane  wanted  a  compact  disk  player.  However,  they 
each  only  had  $50  left  at  the  end  of  each  month  paying  after  their  expenses. 
Tom,  Sue,  Jane,  and  Joe  all  got  together  to  solve  the  problem.  They  made 
four  slips  of  paper  with  the  numbers  1,2,3,  and  4  written  on  them.  They  put 
them  in  a  hat  and  each  drew  out  one  slip.  Jane  got  the  slip  with  the  4  written 
on  it,  and  said,  "Oh  dam,  I  have  to  wait  to  get  my  CD  player.”  Joe  got  the 
slip  with  the  I  written  on  it  and  said,  “Great,  I  can  get  my  car  stereo  right 
away!”  Sue  got  the  number  2,  and  Tom  got  number  3.  In  January,  they  each 
contributed  the  $50  they  had  left.  Joe  took  the  whole  $200  and  bought  a 
Pioneer  car  stereo  at  Service  Merchandise.  In  February,  they  each  contributed 
their  $50  again.  This  time.  Sue  used  the  $200  to  buy  a  Sharp  600  watt  1 .5  cubic 
foot  microwave  at  Service  Merchandise.  In  March,  all  four  again  contributed 
$50.  Tom  took  the  money  and  bought  a  Sanyo  Beta  VCR  with  wired  remote  at 
Service  Merchandise.  In  April,  Jane  got  the  $200  and  bought  a  Technics  CD 
player  at  Service  Merchandise. 

In  addition  to  a  group  given  specific  narratives  (the  instance  group),  some 
experiments  also  used  a  control  group  given  abstract  descriptions  of  the 
schemata  underlying  each  of  the  example  narratives  (abstract  group).  The 
description  of  the  kyeah  schema  given  to  the  abstract  group  follows: 

Suppose  there  are  a  number  of  people  (let  the  number  be  n )  each  of  whom 
wants  to  make  a  large  purchase  but  does  not  have  enough  cash  on  hand.  They 
can  cooperate  to  solve  this  problem  by  each  donating  an  equal  small  amount 
of  money  to  a  common  fund  on  a  regular  basis.  (Let  the  amount  donated  by 
each  member  be  m.)  They  meet  at  regular  intervals  to  collect  everyone’s 
money.  Each  time  money  is  collected,  one  member  of  the  group  is  given  all  the 
money  collected  (n  x  m)  and  then,  with  that  money,  he  or  she  can  purchase 
what  he  or  she  wants.  In  order  to  be  fair,  the  order  in  which  people  are  given 
the  money  is  determined  randomly.  The  first  person  in  the  random  ordering  is 
therefore  able  to  purchase  their  desired  item  immediately  instead  of  having  to 
wait  until  they  save  the  needed  amount  of  money.  Although  the  last  person 
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does  not  get  to  buy  their  item  early,  this  individual  is  no  worse  off  then  they 
would  have  been  if  they  waited  until  they  saved  the  money  by  themselves. 

Since  subjects  in  the  abstract  group  had  been  directly  told  the  content  of  the 
schema,  they  were  presumed  to  have  learned  the  schema.  Consequently,  if 
the  instance  group  performed  as  well  as  the  abstract  group  on  a  task  requir¬ 
ing  knowledge  of  the  general  schema,  then  it  is  reasonable  to  assume  that 
the  subjects  in  the  instance  group  had  also  acquired  the  schema. 

In  one  experiment,  subjects  in  the  instance  group  were  asked  to  ‘‘write, 
in  abstract  terms,  a  description  of  the  general  technique  illustrated  in  the 
narrative.”  In  general,  subjects  were  able  to  produce  good  descriptions  of  a 
plan  schema  after  observing  only  one  instance.  The  following  is  the  descrip¬ 
tion  of  the  kyeah  schema  written  by  one  subject: 

Suppose  in  a  group  of  people,  each  person  would  like  to  buy  something  expen¬ 
sive,  but  over  a  period  of  time,  each  person  cannot  earn  enough  to  buy  what 
he  would  like.  By  using  random  selection,  each  person  could  be  assigned  a 
number,  when  the  group  had  saved  enough  money  together  to  purchase  an 
item,  the  person  with  the  first  number  would  get  his  item.  This  would  continue 
for  the  rest  of  the  group  until  everyone  had  gotten  what  he  wished. 

In  another  experiment,  subjects  in  the  instance  group  were  told  to  “write 
another  story  in  which  characters  use  the  general  method  illustrated  in  the 
story  but  that  is  otherwise  as  different  as  possible”  while  subjects  in  the 
abstract  group  were  told  to  “write  a  story  in  which  particular  individuals 
use  the  technique  described  in  the  passage  in  a  specific  case.”  In  general, 
both  groups  produced  equally  good  examples  of  the  schema  and  the  subjects 
in  the  instance  group  produced  examples  quite  different  from  the  original 
instance.  A  third  experiment  involved  having  subjects  in  both  groups  answer 
a  set  of  questions  constructed  to  test  their  understanding  of  the  abstract 
schema.  The  two  groups  were  able  to  answer  these  questions  equally  well. 
The  instance  group  correctly  answered  85%  of  the  questions  compared  with 
81%  for  the  abstract  group.  In  general,  the  equivalent  performance  of  the 
two  groups  on  tasks  designed  to  test  knowledge  of  the  general  schema,  in¬ 
dicate  that  subjects  in  the  two  groups  had  learned  the  schema  equally  well. 

These  experiments  support  the  claim  that,  like  GENESIS,  people  can  learn 
a  plan  schema  by  explaining  and  generalizing  a  single  narrative.  However, 
also  like  GENESIS,  people  can  only  perform  EBL  when  they  can  explain  all 
the  actions  composing  the  schema.  Ahn  and  Brewer  (1988)  present  additional 
experiments  demonstrating  subjects’  inability  to  learn  plan  schemata  from  a 
single  example  when  they  cannot  construct  a  complete  explanation.  For  ex¬ 
ample,  subjects  could  not  learn  a  schema  for  an  American  Indian  potlatch 
ceremony  from  one  example  because  they  do  not  have  the  appropriate 
cultural  knowledge  to  understand  the  motivations  for  all  of  the  actions. 
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5.  RELATION  TO  OTHER  WORK 
5.1  Relation  to  Work  in  Learning 

The  small  amount  of  previous  work  in  learning  for  understanding  and  plan 
recognition  has  employed  similarity-based  methods.  IPP  (Lebowitz,  1980) 
was  a  text-understanding  system  which  used  incremental  conceptual  cluster¬ 
ing  methods  to  learn  specializations  of  existing  plan  schemata.  GENESIS, 
on  the  other  hand,  uses  explanation-based  methods  to  learn  novel  plans  that 
are  combinations  of  existing  schemata.  However,  like  IPP,  the  schemata 
GENESIS  learns  affect  its  understanding  of  subsequent  narratives. 

As  previously  mentioned,  most  work  in  EBL  has  been  concerned  with 
classification  and  problem  solving  as  opposed  to  understanding.  One  other 
EBL  system  that  improves  its  ability  to  explain  observed  behavior  is  ARMS 
(Segre,  1988),  which  learns  robot  assembly  plans  from  observation.  How¬ 
ever,  unlike  GENESIS,  ARMS  assumes  that  the  system  can  observe  all  exe¬ 
cuted  actions  and  is  incapable  of  using  schemata  to  infer  missing  actions.  A 
story-understanding  system  must  handle  missing  information  since  narratives 
rarely  mention  all  of  the  actions  that  took  place. 

Most  EBL  systems  construct  explanations  explicitly  for  the  sole  purpose  of 
learning  and  do  not  use  their  explanations  for  other  purposes.  In  GENESIS, 
explanations  are  constructed  primarily  for  the  task  of  understanding.  The 
same  explanations  used  by  the  learning  process  also  support  question  answer¬ 
ing,  paraphrasing,  and  other-  understanding  tasks.  Explanation  is  seen  as 
a  fundamental  process  that  serves  many  functions,  only  one  of  which  is 
learning. 

The  standard  view  of  EBL  is  improving  efficiency  by  operationalizing 
existing  concepts  (Mitchell  et  al.,  1986).  Consequently,  EBL  has  been  criti¬ 
cized  for  its  inability  to  learn  facts  that  are  not  logically  entailed  by  its  exist¬ 
ing  knowledge,  or  in  other  words,  for  its  inability  to  learn  at  the  knowledge 
level  (Dietterich,  1986).  Although  GENESIS  is  probably  best  viewed  as 
operationalizing  knowledge  for  plan  recognition,  it  can  also  be  viewed  as 
knowledge-level  learning  of  specialized  concepts  like  kidnapping,  murder 
for  inheritance,  and  so  on.  Under  the  operationalization  view,  the  existing 
concept  being  operationalized  when  learning  such  plans  is  something  like 
WEALTH-ACQUISITION-SEQUENCE  (Mitchell  et  al.,  1986).  This  is  a 
very  general  concept  that  includes  such  diverse  plans  as  working  for  a  living, 
investing  in  the  stock  market,  stealing,  and  so  on.  However,  GENESIS’ 
learned-plan  schemata  are  specializations  of  this  concept  supported  by  a 
particular  explanation  structure.  In  general,  explanation-based  generaliza¬ 
tion  learns  specializations  of  the  target  concept,  that  is,  it  learns  only  suffi¬ 
cient  conditions  for  being  a  member  of  the  target  concept  rather  than 
necessary  and  sufficient  conditions.  Since  GENESIS  has  the  ability  to  asso¬ 
ciate  inductively  new  words  like  “kidnap”  with  its  specialized  plan  schemata 
and  to  categorize  subsequent  events  as  instances  of  these  schemata,  it  can  be 
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viewed  as  performing  knowledge-level  concept  learning.  Flann  and  Dietterich 
(1989)  have  referred  to  this  type  of  learning  as  theory-based  concept  special¬ 
ization. 

The  fact  that  GENESIS  learns  such  specialized  concepts  from  observation 
means  that  it  can  also  be  viewed  as  an  explanation-based  form  of  concep¬ 
tual  clustering  (Michalski  &  Stepp,  1983).  The  system  is  given  unclassified 
examples  in  the  form  of  narratives  and  categorizes  them  into  conceptual 
clusters  such  as  kidnapping,  murder  for  inheritance,  and  so  forth.  Examples 
with  the  same  explanation  structure  are  grouped  together  in  the  same  cluster. 
Since  learned  schemata  are  used  to  index  events  in  memory,  examples  of  a 
cluster  are  also  stored  in  memory.  The  clusters  are  “conceptual”  because 
the  features  in  the  explanation  structure  function  as  a  concept  definition. 
This  approach  to  conceptual  clustering  is  very  different  from  the  standard 
similarity-based  approach  (Fisher,  1987;  Michalski  &  Stepp,  1983). 

Generally,  EBL  is  only  considered  to  be  useful  for  improving  efficiency. 
Since  understanding  is  a  subjective  task  (Carbonell,  1979),  in  addition  to 
improving  efficiency,  learned  schemata  can  affect  how  GENESIS  interprets 
an  event.  For  a  given  narrative,  there  are  generally  several  possible  explana¬ 
tions  connecting  the  individual  facts  together.  Each  explanation  represents 
a  different  interpretation  of  the  text.  Most  plan-based  understanding  sys¬ 
tems  use  heuristic  search  and  settle  on  the  first  explanation  they  find.  Since 
GENESIS  prefers  to  understand  a  narrative  using  an  existing  schema,  learn¬ 
ing  a  schema  can  affect  interpretation.  Like  people,  the  system  is  influenced 
by  its  experience  and  tends  to  prefer  explanations  that  were  successful  in  the 
past.  For  example,  without  an  explicit  schema  for  “solicitation  entrapment,” 
it  is  unlikely  that  a  system  would  interpret  the  sample  test  narrative  the  way 
GENESIS  does  after  learning  DressSolicitArrest.  A  nonleaming  system 
would  probably  find  other  explanations  first,  like  ones  involving  the  presence 
of  unmentioned  police  officers  in  the  vicinity  of  the  crime. 

5.2  Relation  to  Work  in  Text  Understanding 

Several  recent  projects  in  text  understanding  have  focussed  on  the  use  of 
marker  passing  and  intersection  search  to  find  connections  between  inputs 
and  perform  plan  recognition  (Chamiak,  1986;  Norvig,  1987).  This  approach 
allows  the  search  performed  in  plan-based  understanding  to  take  advantage 
of  the  parallelism  inherent  in  marker  passing.  Although  it  can  greatly  im¬ 
prove  efficiency,  marker  passing  does  not  change  the  basic  intractability  of 
plan-based  search.  Consequently,  it  does  not  eliminate  the  need  for  schema 
acquisition. 

Marker  passing  is  a  simple  computational  process  which  does  not  keep 
track  of  variable  bindings  nor  examine  the  consistency  and  explanatory 
power  of  the  paths  it  constructs.  Consequently,  it  tends  to  find  a  large 
number  of  irrelevant  paths  which  need  to  be  weeded  out  during  a  serial 
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path-evaluation  phase.  Charniak  (1986)  states  that  for  the  small  knowledge 
bases  already  tested,  only  about  1  in  10  paths  found  by  marker  passing  con¬ 
stitute  reasonable  explanations.  This  factor  would  undoubtedly  increase 
with  the  size  of  the  knowledge-base  and  the  length  of  the  paths  allowed. 
Therefore,  if  the  gaps  between  inputs  are  large,  a  marker-passing  system 
capable  of  finding  the  long  paths  representing  meaningful  explanations  is 
also  likely  to  find  a  large  number  of  irrelevant  paths  which  have  to  be 
evaluated  and  discarded.  Consequently,  even  marker  passing  is  incapable  of 
efficiently  understanding  certain  events  in  the  absence  of  a  schema. 

However,  marker  passing  is  not  incompatible  with  schema  learning.  In 
fact,  a  marker-passing  system  could  be  used  to  improve  GHNESIS’s  ability 
to  explain  and  learn  from  novel  events.  The  schemata  learned  by  generalizing 
such  events  would  alter  the  knowledge  base  by  shortening  the  paths  between 
facts  in  the  schema.  This  would  improve  the  efficiency  of  understanding 
future  instances  of  the  schema  and  increase  the  chance  that  the  schema  is 
used  to  explain  an  event. 

6.  PROBLEMS  FOR  FUTURE  RESEARCH 

The  effect  of  learning  on  performance  has  not  been  adequately  studied  in 
GENESIS  since  the  current  system  does  not  perform  enough  plan-based 
search  to  permit  a  fair  comparison  of  learning  and  nonlearning  versions. 
Schema  acquisition  improves  performance  because  plan  verification  is  in¬ 
herently  incapable  of  explaining  certain  events  in  the  absence  of  a  schema. 
The  claim  is  that  although  exhaustive  search  can  find  explanations  when 
plan  verification  cannot,  its  run-time  performance  would  be  much  worse 
than  a  schema-based  approach.  To  demonstrate  this  claim  conclusively,  ex¬ 
periments  are  needed  comparing  learning  and  nonlearning  versions  of  a 
plan  recognition  system  that  conducts  an  exhaustive  search.  This  would 
constitute  a  direct  empirical  analysis  of  the  trade-off  between  search  and 
knowledge  for  the  task  of  plan  recognition. 

On  a  related  topic,  research  in  learning  for  problem  solving  has  shown, 
that,  unless  the  utility  of  learned  information  is  monitored,  learning  can 
actually  degrade  rather  than  improve  overall  performance  (Minton,  1988). 
Although  GENESIS  has  several  criteria  for  insuring  the  utility  of  learned 
schemata,  additional  techniques  may  be  needed  to  insure  that  learning 
actually  improves  overall  understanding  performance. 

Another  area  for  future  research  concerns  schemata  with  unexplainable 
aspects.  Unlike  plan  schemata  that  can  be  acquired  from  one  instance  using 
EBL,  many  scripts,  such  as  a  wedding  ceremony  or  a  birthday  party,  con¬ 
tain  conventional  as  well  as  causally  necessary  aspects.  Recent  psychological 
experiments  suggest  that  people  use  a  combination  of  explanation-based 
and  similarity-based  methods  to  acquire  such  concepts  (Ahn  &  Brewer, 
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1988).  Integrated  learning  methods  (Lebowitz,  1986)  are  needed  that  can  ac¬ 
quire  concepts  with  both  explainable  and  unexplainable  aspects.  Mooney 
and  Ourston  (1989)  present  an  initial  approach  to  this  problem. 

7.  CONCLUSION 

This  article  has  shown  how  EBL  can  acquire  plan  schemata  from  a  single 
observed  instance,  as  well  as  how  learned  schemata  can  improve  the  perfor¬ 
mance  of  plan  recognition.  The  GENESIS  system  was  presented  as  an  ex¬ 
ample  of  a  narrative  understanding  system  that  uses  EBL  to  improve  its 
performance.  Learned  schemata  allow  GENESIS  to  use  schema-based  under¬ 
standing  techniques  when  interpreting  events,  thereby  avoiding  the  expensive 
search  associated  with  plan-based  understanding.  In  addition  to  improving 
efficiency,  schema  acquisition  effects  how  the  system  interprets  events.  The 
system  prefers  to  reuse  explanations  from  prior  experience.  Learned 
schemata  also  function  as  new  concepts  that  can  be  used  to  cluster  examples 
and  index  events  in  memory. 
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